Papers with high-resource settings
Fortification of Neural Morphological Segmentation Models for Polysynthetic Minimal-Resource Languages (N18-1)
Copied to clipboard
| Challenge: | Morphological segmentation for polysynthetic languages is challenging because of limited training data. |
| Approach: | They propose two new multi-task training approaches that improve performance for Mexican polysynthetic languages . they also propose cross-lingual transfer as a third way to fortify their neural model . |
| Outcome: | The proposed models improve on Mexicanero, Nahuatl, Wixarika and Yorem Nokki . the proposed models reduce the amount of parameters by close to 75% . |
K-hop neighbourhood regularization for few-shot learning on graphs: A case study of text classification (2023.eacl-main)
Copied to clipboard
| Challenge: | We show that few-sample word-document graphs can be used for improved learning in low-resource settings. |
| Approach: | They propose a method to utilize word-document graph properties for improved learning in low-resource settings by using a regularizer for heterogeneous graphs. |
| Outcome: | The proposed method outperforms a baseline TextGCN with 17% accuracy over eight languages while performing on par with the state-of-the-art models. |
Achilles-Bench: A Challenging Benchmark for Low-Resource Evaluation (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing low-resource datasets that challenge neural networks cause over-estimated performance, despite promising yet saturated results in high-res settings. |
| Approach: | They propose a benchmark Achilles-Bench to better evaluate the learning ability of neural networks in low-resource settings. |
| Outcome: | The proposed benchmarks show that even pre-trained language models show performance drops on NLP tasks. |
EdiT5: Semi-Autoregressive Text Editing with T5 Warm-Start (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Pre-trained seq2seq models have established strong baselines for text-to-text transduction tasks. |
| Approach: | They propose a semi-autoregressive text-editing approach that combines the strengths of non-auto-regressively text- editing and autoregressive decoding. |
| Outcome: | The proposed model is faster at inference times than conventional models while being capable of modeling flexible input-output transformations. |
Label Semantic Aware Pre-training for Few-shot Text Classification (2022.acl-long)
Copied to clipboard
| Challenge: | Existing models for text classification use label semantics but few studies have attempted to give models access to informative representations of labels. |
| Approach: | They propose to use label semantics to train generative models by performing secondary pre-training on labeled sentences from a variety of domains. |
| Outcome: | The proposed approach improves generalization and data efficiency of text classification systems while maintaining comparable performance to state-of-the-art models. |
Grounding Multilingual Multimodal LLMs With Cultural Knowledge (2025.emnlp-main)
Copied to clipboard
| Challenge: | a new data-centric approach could address cultural gaps in multimodal large language models . despite being trained on billions of image-text pairs, today's models are biased towards English and Western data. |
| Approach: | They propose a data-centric approach that directly grounds MLLMs in cultural knowledge. |
| Outcome: | The proposed approach outperforms open-source models on cultural-focused benchmarks without degrading results on mainstream vision–language tasks. |